Papers with WikiText-2 benchmark
Barack’s Wife Hillary: Using Knowledge Graphs for Fact-Aware Language Modeling (P19-1)
Copied to clipboard
| Challenge: | Existing language models are only capable of remembering facts seen at training time, and have difficulty recalling them. |
| Approach: | They introduce a knowledge graph language model with mechanisms for selecting and copying facts from a Knowledge graph that are relevant to the context. |
| Outcome: | The proposed model outperforms a baseline language model in generating factual knowledge and generating sentences that require factual information. |